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To develop a taxonomy of Cross Examination Debate 
Association fCEDA) critics, a study associated professed judging 
philosophy and responses to survey questions with ballot behavior and 
elaborated judging profiles. Subjects were debate critics who judged 
rounds at CEDA tournaments in the Northeast during the Spring 1989 
season, in all, 13 critics had sufficient quantities of all three 
measures (questionnaire, philosophy statement, and ballots) to be 
included in the pilot study. First, analysis revealed that 
traditional paradigms are associated more strongly to key 
discriminators than are merged or new profile types. Second, the 
criteria discriminators, despite their limitations, were associated 
with relatively clearly defined profile types? however, these profile 
types are not conceptually coherent. Third, the present analysis 
suggests that at least the following profile types should be 
considered as targets of future research in CEDA paradigm use: 
value-comparison and argument skills, argument skills and hypothesis 
testing, argument critic, stock issues, and analytic centered. 
Finally, the descriptive boundaries between paradigms are porous and 
unreliable. The low correlation distinctiveness between profile types 
indicated that paradigm adherence by critics is not a highly valued 
behavior. Elaboration of criteria discriminators should reveal 
whether the traditional or profile candidates do support taxonomic 
elements which would inform debaters of real differences existing 
among their judge-critics. (One figure and nine tables of data are 
included; 19 endnotes and 14 references are attached.) (MG) 
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A Taxonomy o£ CEDA Debate Critics 



The study in progress is an attempt to develop a taxonomy oi 
CEDA debate critics based upon their decision criteria. It is 
exploratory in at least two dimensions. First, the study 
attempts to associate (1) professed judging philosophy and (2) 
responses to survey questions with (3) ballot behavior. While 
statements on judging philosophies and preferences expressed 
through survey Instruments may be taken as "ought" statements, 
the pattern of decision criteria employed on ballots constitutes 
actual practice. One expects to find consistency between the 
philofe . :»hies and surveys on one hand and the ballots, on the 
other . 

Second, the study attempts to develop "judging profiles." 
Unlike NDT debate (characterized by fairly well-articulated 
"paradigms" \ CEDA debate offers less well-defined (let alone 
accepted) perspectives regarding how rounds should be evaluated. 
Our development of "judging profiles" is an attempt to discover 
(1) whether tacit paradigms exist in CEDA and (2) what elements 
these paradigms may r:ontain. A taxonomy of debate critics would 
allow standardized review of judges' work products (ballots and 
philosophies) and would encourage development of sound principles 
of criticism on ballots. Tt also would assist educators in 
organizing and conducting debate training, and facilitate 
pedagogical organization of forensic literature. 

This manuscript reports the second part of a pilot study. 
Analysis of the first part (Dudczak and Day 1989) addressed the 
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correspondence among preferences expressed through judge 
philosophy statements, responses to a survey Instrument, and 
comments/decision criteria expressed on debate ballots. An 
attempt at defining emergent "judging profiles'* is reported in 
this manuscript. 

Justification for this investigation lies in the scarcity of 
information about debate critic decision criteria. Previous 
researchers attempted to determine whether judging behavior 
corresponded with the assumed characteristics of decision 
paradigms . 

The earliest investigations (Cox 1974; Cross & Matlon 1973; 
Thomas 1977) were limited to NDT debate. They shared a 
limitation common to subsequent studies (Buckley 1983; Lee, Lee & 
Seeger 1983; Gaske, Kugler & Theobald 1985) in that they relied 
exclusively on self-report. Although data acquired by such means 
may reflect prevailing attitudes within the forensic community, 
they do not validate whether reported preferences actually are 
applied as criteria in the resolution of debate rounds. 
Moreover, although the Gaske, Kugler, and Theobald research 
attempted to discriminate among CEDA judging paradigms, it relied 
upon unequal (and generally subcritical) cell sizes that violated 
the assumptions of parametric statistical analysis (61-65). 
Judges may have articulated perspectives in instruments used for 
any of these studies which they subsequently abandoned in their 
Judging behavior. 

only three studies have taken the artifacts of debate as thr 

4 



Taxonomy of CEDA Debate Critics, ^ 
basis for analysis. Bryant ( 1983) compared selected NDT aaJ CED.\ 
debates In order to analyse the application of evidence. His 
results are contaminated, however, by a failure to control for 
differences in time format and competitors* varying skill and 
experience levels (3-4). 

Hollihan, Riley, and Austin (1983) investigated "themes" 
differentiating CEDA critics from their NDT counterparts. T'ley 
employed content analysis to compare ballots written by critics 
judging under the two debate formats. Results indicated that 
CEDA judges hold different "visions" than those embraced by NDT 
critics . 

However, Hollihan ^ ai limited the comparison of judges and 
their decision criteria in two important ways. First, they 
treated CEDA (and NDT) judges as undifferentiated within type. 
No comparisons were made among CEDA critics (or NDT critics). 
These assumptions are suspect when applied to NDT judges because 
it is commonly held that they apply competing paradigms (Cox 
1974; Cross & Matlon 1978; Thomas 1977). There also is reason to 
expect that varying judging perspectives operate in CEDA debate 
(Buckley 1983). 

Second, Hollihan ei al. only looked at ballot comments as an 
artifact of paradigm. Without knowledge of a judge's prior 
preferences regarding debate practice or theory, one cannot 
determine whether the absence of ballot comments reflects debater 
adaptation to the critic, inconsistency on the part of the judge, 
or a simple lack of relevant paradigmatic stimuli in a given 
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round. At the time of the Hollihan g.t. research, CEDA had not 
yet instituted a national tournament, with its judge philosophy 
booklet, NOT had employed judge philosophies since the 1970s. 
Thus, differences in ballot comments reported by Hollihan gt. 
may reflect, in part, the greater availability of judging 
preference statements for NDT judges. 

Now that CEDA judge philosophy statements are available frc.;i 
the national tournament, the levels of consistency between 
professed philosophy and actual ballots can be analyzed. Dudczak 
and Day (1989) assessed levels of consistency among philosophy 
statements, questionnaires, and debate ballot critiques. They 
reported only two items from the questionnaire that correlated 
even moderately with comparable ballot comments'-. Judging 
paradigm preferences indicated on the questionnaire yielded 
thirteen additional moderately strong correlations with ballot 
comments.* (12~14)=» when consistency of critic response across 
the two work products and instrument were computed, judges' 
alleged preferences were consistent with their actual behavior 
little more than half the time (Mean = 54.9%).* 

Dudczak and Day also found that critics devoted a greater 
proportion of their elimination round ballots to decision 
criteria (vs. critique) and to substantive elements (vs. 
presentational elements) compared to their preliminary round 
ballots. (17-18) Their data failed to support hypotheses that 
ballots written by critics employing audience-centered paradigms 
feature (1) proportionally more presentational (vs. substantive) 
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Taxonomy of CEDA Debate Critics^ ^ 
elements and (2) more critique (vs. decision) comments than 
ballots by analytic-centered judges (16-17).* 

The Dudczak and Day pilot study also has serious 
limitations, however. The numbers oi critics (13) and ballots 
(170) analyzed are neither sufficient for statistical 
significance nor representative of the national population of 
CEDA debate critics, having been dravn exclusively from tho 
Northeastern region. Inter-coder reliability was not assessed 
for the content analysis of ballots and philosophies because of 
time and funding constraints.* Finally, the worksheets used for 
data reduction of philosophies and ballots need to be revised so 
as to identify paradigm pre£cA.ences more discretely and to 
discriminate among variables differentiating judge-specific 
ballot behavior. (19-21) 

The study reported here is an extension of the Dudcsak ond 
Day pilot study analysis reported at the 6th SCA/AFA Summer 
Conference on Argumentation in Alta, Utah (August 1989). it is 
guided by the following research questions: 

#1 Which traditionally recognized paradigms are sufficiently 
distinct in terms of decision criteria to stand alone as 
taxonomic elements, and which should be merged with others 
based upon actual ballot behavior? 

#2 What key decision criteria (discriminators) characterize 
candidate taxonomic elements by clustering with other 
dimension criteria for specified profile types? 

#3 What is the strength of association between candidate profile 
types and key criteria discriminators? Is the association 
stronger for traditional paradigms or for new profile types 
examined in the current study? 

#4 How do the profiles rank to one another based upon their mean 
predictive ability? 

ERIC ' 
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METHOD 

The current analysis begins from Dudczak and Day's 
correlation o* professed judging paradigms with selected ballot 
decision criteria (Table 1) . That correlation attempted to 
identify discriminants which may characterize judging paradigms. 

Structured data (from the questionnaire and from the template 
portions of debate ballots) and unstructured data (from written 
portions of ballots and judging philosophies) were integrated in 
that previous analysis. The advantage of using both survey 
research and content analysis is that the two techniques genor.nts 
complementary findings which are more val*.d than those obtaIn<;iC; 
when using either alone (Paisley 1969; Webb and Roberts 1969). 
Options offered in structured instruments reflect preconceptions 
held by the researcher. Respondents* choices are dictated by tha 
Instrument, Content analysis, on the other hand, begins with a 
view of reality held by the subject and attempts to conform that 
view to the analytic scheme of the researcher (Holsti 1969; 
Krippendorff 1980). 
Subjects : 

Subjects used in this pilot study were debate critics who 
judged debate rounds at CEDA tournaments in the Northeast during 
the Spring 1989 season. 
Material : 

Work products and the instrument examined in this study 
included 1) judging philosophies solicited prior to tournaments, 
7) ballots completed during competition at tournaments, and 3) a 
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Taxonomy of CEDA Debate Ctitlcs, 7 
structured questionnaire administered at tournaments followl»ig 
completion of a majority o£ the rounds (typically after Round 
Five) . 

Twenty subjects compl«*ted the questionnaire. Philosophy 
statements for 16 of these respondents were gathered at one of 
five tournaments from which ballots were obtained or were taken 
from the 1988 CEDA national tournament philosophy book. Ballots 
in sufficient number for analysis (six or more) were available 
for 17 of the 20 subjects. 

The study was unable to use 35 percent of the questionnaires 
because subjects had completed too few ballots or because no 
judging philosophy statement was available for the critic. 
Nearly 70 percent of 551 available ballots also were lost, 
largely because there was no questionnaire for the critic. Some 
ballots also were unusable because no philosophy statement wa3 
available . 

In all^ 13 critics had sufficient quantities of all three 
measures (questionnaire, philosophy and ballots) to be included 
in the pilot study. Twenty of their ballots were blank, 
therefore unused. The small number of critics used for the pilot 
study seriously limits generalizability c£ results. 
Nevertheless/ findings do serve to validate the instruments and 
procedures for subsequent research.' 

The one instrument and two work products used in the study 
may be visualized conceptually in a two-by-two table. Both the 
philosophy and questionnaire are normative ("ought") documents; 
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ballots are applied {i.e., actual behavior). The philosophy and 
comment portions of ballots are unstructured; the questionnaire 
and template (top) portions of ballots are structured. Using 
these distinctions, future study may examine content, constru:*': 
and predictive validity of these types of documents. 

FIGURE 1 

Construct and technique matrix of tools in the study 



normative 



Unstructured 



PHILOSOPHY 



>>>>>>>>>>>>>>>> 



applied 



BALLOT CvOMMENTS 



V : 
QUESTIONNAIRE >>>>>>>>>>>>>>>> B^ILLOT METRICS 

Structured : 
Procedure : 

A two-page questionnaire incorporating 35 Likert Scale item.?, 
six yes/no selections, two multiple option questions, and five 
single-selection choices was administered to judges at CEDA 
debate tournaments. Two of these questions were repeated from 
Buckley (1983) in an attempt to partially replicate the earlier 
study. The questionnaire was administered with little advance 
publicity, in order to prevent critics from modifying their 
decision criteria In anticipation of zhQ study. 
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Taxonomy of CEDA Debate critics, ^ 
Official ballots submitted by judges at five Spring 1383 CZDA 
tournaments comprised the second source of data. One hundred and 
ninety ballots were analysed, of vhich 170 (89.5%) vere usable. 
These ballots were distributed among the thirteen judges such 
that each critic's share o£ the sample pool fell within + 50*^ of 
random share. 

The third source of data was the judging philosophy 
statements, already described. The majority of vork products and 
questionnaires were collected at the Syracuse Debate Invitational 
tournament held during the last week of January 1989. Additional 
data were collected at other CEDA tournaments in the Northeast 
during the spring semester (Marist, Richmond, Cornell and William 
& Mary) . 

Formal processing began with tabulation and statistical 
analysis of the questionnaire instrument. A univariate analysis 
revealed nine discriminants influencing decisions^. From this 
review a set of research concerns was developed. Next, ballot 
templates were developed. Then a content analysis of the judging 
philosophies and ballot comment sections was conducted. An 
attempt was made to correlate ballot and philosophy content 
variables to elements addressed by the survey. The study also 
examined the proportion and consistency of ballot comments 
regarding debaters vs. ballet critiques addressed to the 
resolution of issues. 

Analytic procedures to assess each of the research questions 
were devised. For research question #1, analysis attempted to 
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Taxonomy of CEDA Debate Critics, 10 
discriminate two sets of paradigms: (1) paradigm pairis vhich vere 
atypically similar in terms of Hey decision criteria, and (2) 
those which are atypically dissimilar on the same criteria. 
Paradigm pairs which are atypically similar become candidates for 
merger with each other as taxonomic elements becaurse they reflect 
the same underlying ballot behavior. Paradigm pairs which are 
atypically dissimilar become candidate taxonomic elements of 
their own because they appear to reflect unique aspects of ballot 
behavior. The compatibility of components within each candidate 
pair is assessed by examining the ratio of correlations for each 
key discriminator. Candidate profile pairs are identified by 
merging similar paradigms or isolating components of dissimilar 
pairs . 

For research question #2, controlling for each selected 
profile type in turn, correlations were generated among all key 
discriminators to identify associations among discriminators as a 
description of profile type. Audience Centered and Analytic 
Centered metaparad igms posited by Dudczak and Day were included. 

For research question ft3, each candidate profile type was 
correlated with each of the three key criteria discriminators 
(Qnalanal, Af burden, and Evapl ) to identify reasonably strong 
associations as potentially descriptive of the target profile 
types. Each profile's correlations {for each discriminator) wera 
compared to the coL'respond ing mean for all profiles of the 
alternate type (traditional versus suggested candidates) to 
deterittine whether traditional or candidate profiles show stronj-^ 
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Taxonomy oiE CEDA Debate crlticc.^ H 
rc^lationships vith key discriminators. 

For reserach question #4, the absolute mean for all key 
discriminators for each profile type was ranked, assigning the 
highest rank to the highest mean correlation. This allowed 
paradigms to be compared on aggregate strength of key 
discriminator; . 

RESULTS 

Preliminary analysis in Dudczak and Day (1989) compared 
judging g-aradig^as with reasons for decision cited in debate 
ballots. Correlations suggested that several clusters of bsllot 
behavior were characteristic of various paradigms. Table 1 
pre-'sents the associations found between paradigms and ballot 
behavior for the list of discriminants selected. These 
correlations, while falling below the conventional .80,* suggest 
Judging behaviors which transcend paradigm preference. 

TABLE 1 

Paradigms vs. reasons for decision 



BALLOT COMMENTS 



PROFESSED 


CNTRIN 


TOPICL 


QUALANL 


EVCONTX 


AFBURDN 


EVAPL 


Tabula Rasa 


ND 


.043 


.049 


.698 


.316 


.C98 


value Comparison 


.674 


.012 


.021 


.696 


.052 


.078 


Policy Implications 


ND 


.024 


.068 


ND 


.024 


.110 


Argument Skills 


.669 


.012 


.010 


.694 


.127 


.095 


Argument Critic 


.644 


.046 


. 553 


.685 


.122 


. 472 


stock Issues 


ND 


.064 


.015 


ND 


. 449 


.143 


Public Audience 


ND 


.156 


.001 


ND 


.126 




Hypothesis Testing 


ND 


.089 


.025 


.693 


. 207 


.156 


Judicial Model 


.661 


.086 


.589 


.691 


.145 


.132 


Other 


ND 


.143 


.564 


ND 


.202 


.240 



ND = Insufficient Data 



o 
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Taxonomy of CEDA Debate Critics, 1- 
Research question SI asked whether the traditional paradi^^m.^ 
should be merged with others or stand as sufficiently distinct 
taxonomic elements. Of the six ballot discriminants, only three 
(Quality of Analysis, Affirmative Burden of Proof, and Evldenca 
Applicability) revealed potential patterns of similarity and 
difference among the paradigms. To further test associations 
among the several paradigms, potentially similar paradigm pairc 
were merged and potentially distinct (isolated) pairs of 
paradigms were contrasted on discriminant items. This was done 
by matching the discriminant correlations of the ten paradigm;^ 
(from Table 1) to one another. The goal was to determine hov 
many of the discriminants were present in common for each 
paradigm pair. The following pattern of commonality was obtained 
on the six key discriminators (Table 2).^*' 

TABLE 2 

Commonality of Correlations Among Paradigms on Key Discriminators 



yVMBER OF MATCHES PEK FARAPI<?M PAIR (1,2) 

TR VC PI AS AC SI PA HT JM OT 



TR 434232431 

VC 46432440 

PI — 4 2 3 2 3 2 0 

AS — 4 3 3 5 5 1 

AC — 1 1 3 5 3 

SI — 2 3 2 2 

PA --433 

HT --4 3 

JM 3 
OT 
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The presence of apparent similarity between four pairs of 

paradigms (those which have five or six similar correlations for 

the six discriminators) suggests that an underlying common 

element exists. This may indicate indistinctive boundaries 

between the paradigms. These paradigms may be merged to their 

matched counterparts: 

Value Comparison - Argument Skills 
Argument Skills - Hypothesis Testing 
Argument Skills - Judicial Model 
Argument Critic - Judicial Model 

Of these four candidate merged pairs of paradigms, two (AS- 
JM and AC~JM) exhibited high ratios between component paradigm 
correlations on each of two key discriminators (Quality of 
Analysis for AS-JM and Applicability of Evidence for AC~JM). 
This suggests that these pairs are not sufficiently similar to be 
considered further as combined candidate profiles. 

The other two pairs (Value Comparison - Argument Skills and 
Argument skills - Hypothesis Test) are relatively similar in 
terms of the key discriminators.^'* Table 3 presents the key 
criteria discriminators characteristic of potential merge pairs. 
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Taxonomy of CEDA Debate Critics, 14 
TABLE 3 

Key Criteria Discriminators Characteristic of Profile Merge Pairs 



CRITERIA DISCRIMINATORS 



QUALANAL 

PI P2 Ratio M 

VC~AS .021 ,010 2.1 .000 

AS-HT .010 .025 2.5 .015 

AS-JM .010 .589 58,9 -.010 

AC-JM .553 .589 1.1 -.140 



AFBURDEN 
PI P2 Ratio M 



052 
127 
127 
122 



127 
207 

;.45 

145 



2.4 
1.6 
1.1 

1.2 



-.070 
.170 
-.170 
-.170 



PI 

.078 
.095 
.095 
.472 



EVAPL 
P2 

.095 
.156 
.132 
.132 



Ratio 

1.2 
1.6 • 
1.4 
3.6 



M 

.100 
-.150 
-.130 
-.150 



Notes : 

1. Intent is to validate merger of selected pairs o£ paradigms. 

2. PI - First traditional paradigm; P2 « second traditional 
paradigm; Ratio = P1:P2; M = Correlation of PI and P2 together 
with the target discriminator. 

None of the merge pairs is correlated strongly enough with 
any of the key discriminators to assign a discriminator as 
characteristic of the candidate profile type based solely on this 
analysis. In all cases, the correlation of merged pairs with key 
discriminators is lower than correlations of each of the pair's 
components to the same discriminators. However, this may be a 
statistical artifact of combining originally independent 
paradigms .^^ 

Analysis then attempted to determine which traditionally 
recognized paradigms were sufficiently distinct to stand alone ti3 
taxonomlc elements. The ten paradigms were matched on the six 
discriminators (from Table 1) to determine patterns of 
dissimilarity. The greater the number of "mismatched" 
discriminators should indicate distinctiveness.^'* 
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Taxonomy o£ CEDA Debate Critics, IT' 
TABLE 4 

Lack of Commonality Among Paradigms on Key Discriminators 



mmm QF-MTgMATCHEg PER PftRAPIgM ?hl^R (1,2) 

TR VC PI AS AC SI PA HT JM OT 



TR — 000200011 

VC -- 00210011 

PI — 0210011 

AS —210011 

AC —31210 

SI —10 2 1 

PA --Oil 

HT --11 

JM 0 
OT 



From the preceding analysis, seven paradigm pairs are 

sufficiently dissimilar in correlation levels on key 

discriminators to warrant further consideration of their 

component paradigms as independent taxonomic elements: 

Argument Critic _ Stock Issues 
Tabula Rasa - Argument Critic 
Value COiftparlson - Argument Critic 
Policy Implications - Argument Critic 
Argument Skills - Argument critic 
Argument Critic - Hypothesis Tester 
Stock Issues - Judicial Model 

It is notable that Argument critic is featured most prominently, 

suggesting that it has relatively well-defined descriptive 

boundaries and should therefore be considered as an independent 

taxonomic element. Stock Issues is the only other paradigm which 

appears separated from at least two other paradigms'-*. Table 5 

identifies the key criteria discriminators characteristic of the 



ERIC 



17 



Taxonomy of CEDA Debate Critics, IG 

profile isolate pairs. 

TABLE 5 

Key Criteria Discriminators Characteristic o£ Profile Isolates 



CRITERIA DISCRIMINATORS 



QUALANAL 




: AFBURDEN : 


{ EVAPL 




PI P2 


Ratio 


: PI P2 


Ratio ; 


t PI P2 


Ratio 


AC-SI .553 .015 


36.9 ; 


: .122 .449 


3.9 ; 


: .472 .143 


3.3 


TR-AC .049 .553 


11.2 ; 


: .316 .122 


2.6 ; 


: .098 .472 


4.8 


VC~AC .021 .553 


26.3 ! 


1 .052 .122 


2.4 ; 


, .073 .472 


6.1 


PI-AC .001 .553 


553.0 ! 


1 « X26 # X22 


1.0 : 


: .193 .472 


2.5 


AS-AC .010 .553 


55,3 ! 


; .127 .122 


1.0 ; 


• .095 .472 


5.0 


AC-HT .553 .025 


22.1 : 


: .122 .207 


1.7 ; 


. .472 .156 


3.0 


SI-JM .015 .589 


39.3 : 


1 .449 .145 


3.1 : 


. .143 .132 


1.1 



Notes: PI - First traditional paradigm; P2 = Second traditional 
paradigm; Ratio = P1:P2 

Of the seven candidate Isolate pairs of paradigms in Table 
5, one (PI - AC) has low ratios between component paradigm 
correlations on each of two discriminators (Affirmative Burden of 
Proof and Applicability of Evidence) . This suggests that this 
pair is not sufficiently dissimilar to consider its component 
paradigms to be bonafide profile types separately. However, the 
strong dissimilarities shown by the Argument Critic within other 
pairs suggests that only Policy Implications would be dropped 
from further consideration. 

Four other candidate isolate pairs of paradigms (VC - AC, 
AS - AC, AC - HT, and SI - JM) have low ratios between component 
paradigm correlations on one key discriminator each (in three 
cases Affirmative Burden, in one case Applicability of Evidence). 
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Taxonomy of CEDA Debate Critics^ -7 
This suggests that some component of these pairs weakens the 
discriminatory boundary necessary to isolate the paradigm as a 
candidate profile type. Some components of these pairs (e.g.. 
Argument and Stock Issues) also are part of strongly discriminant 
pairs, and therefore, should continue to be considered as profile 
types. Their potentially weaker mates (VC, AS, HT, and JM) can 
be eliminated from further consideration. 

The combined analysis of merged and isolate candidate pairs 
identifies four candidate profile types which warrant further 
study: value Comparison - Argument Skills and Argument Skills - 
Hypotheses Testing as candidate merge pairs, and Argument Critic 
and stock issues as isolate profile types. 

Research question #2 asked what key decision criteria 
(discriminators) characterized candidate taxonomic elements by 
clustering with other dimension criteria. That is, do the three 
key discriminators combine to distinguish the candidate taxonomic 
elements? In addition to the four candidate profile types 
elicited from research question SI, the two candidate profiles 
supported in Dudczak and Day (1983) — Audience Centered^" and 
Analytic Centered^*^ as well as the Tabula Rasa paradigm^® were 
included. Table 6 reports correlations among all key 
discriminators to identify associations among discr imina t:ors a:, a 
description of profile type. 
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Taxonomy of CEDA Debate Critics, 13 
TABLE 6 

Within-Group Correlation of Criteria Discriminators 



Criteria Discriminators 
QUALANAL AFBURDEN EVAPL 



Argument Critic 

QUALANAL -0.13 0.21 

AFBURDEN -0.13 -0.11 

EVAPL 0.21 -0.11 

Stock Issues 

QUALANAL 0.25 -0.24 

AFBURDEN 0.25 -- -0.2 4 

EVAPL -0.24 -0.24 

— Tabula Rasa 
QUALANAL -- 0.12 0.10 
AFBURDEN 0.12 — 0.39 
EVAPL O.IO 0.39 

— Non-Tabula Rasa 

QUALANAL — 0.06 -0.09 

AFBURDEN 0.06 -0.02 

EVAPL -0.09 -0.02 

Cfln<3i<3ate Prof llgg 

Value Comparison-Argument Skills 

QUALANAL -- -0.15 0.01 

AFBURDEN -0.15 0.3u 

EVAPL 0.01 0.30 

Argument Skills-Hypothesis Test 

QUALANAL 0.14 0.07 

AFBURDEN 0.14 -0.06 

EVAPL 0.07 -0.06 

Audience Centered 

QUALANAL — -0.16 0.02 

AFBURDEN -0.16 — 0.10 

EVAPL 0.02 0.10 

Analytic Centered 

QUALANAL — 0.08 -0.05 

AFBURDEN 0.08 — 0.16 

EVAPL -0.05 0.16 
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Of t^e seven candidate profile types, only three (Stock 
Issues, Tabula Rasa, value Comparison-Argument skills) exhibit 
correlations which might be useful In associating key 
discriminators as part of a description of the target profile 
type. Highly similar (although lov,) correlations (.24) among all 
three key discriminators for Stouk Issues hint that these 
criteria may contribute to the definition of a stock Issues 
taxonomlcal element. Higher (but still low) correlations (.39) 
between Affirmative Burden and Applicability of Evidence are 
associated in the context of Tabula Rasa. Comparison of Tabula 
Rasa to non-Tabula Rasa suggests this association truly is 
characteristic of Tabula Rasa critics. A roughly equal 
correlation (.30) existed between the same two discriminators for 
the combined Value-Comparison-Argument Skills profile type.^* 

No clustering of discriminators is indicated for Audience 
Centered or Analytic Centered profile types. 

In summary of results on research question #2, Affirmative 
Burden and Applicability of Evidence may be characteristic of 
Tabula Rasa and Value Comparison-Argument skills profile types. 
All three discriminators may be characteristic of the Stock 
Issues profile type. 

Research question »3 sought to determine whether traditional 
paradigms or new (candidate) profile types were more closely 
associated with key criteria discriminators. To test this 
question, each profile's correlations (for each discriminator) 
was compared to the corresponding mean for all profiles of the 
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alternate type (traditional vs. suggested candidates). Table 7 
reports these results. 

TABLE 7 

Traditional Paradigm and Candidate Profile 
Correlations with Criteria Discriminators 



Traditional Candidate 
Paradigms (1) Profiles (2) 

Argument critic 

QUALANAL 
AFBURDEN 
BVAPL 

Stock Issues 

QUALANAL 
AFBURDBN 
EVAPL 

Tabula Rasa 

QUALANAL 
AFBURDEN 
BVAPL 

Candidate, PXQfileg 
Value Comparison - Argument Skills 



QUALANAL -.047 .000 

AFBURDEN .018 -.070 

EVAPL -.037 .100 

Argument Skills - Hypothesis Test 

QUALANAL -.047 .015 

AFBURDEN .018 .170 

EVAPL -.037 -.150 

Audience centered 

QUALANAL -.0 47 -.050 

AFBURDEN .018 .0 30 

EVAPL -.037 .090 

Analytic Centered 

QUALANAL -.047 .060 

AFBURDEN .018 .310 

EVAPL -.037 .240 



.110 
.115 

.160 



.040 
.520 
.160 



.070 
.350 
.110 



.021 
.017 
.000 



.021 
.017 
.000 



.021 
.017 
.000 
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Notes: 

1. Correlation between profile types and criteria 
discriminators: actual for traditional paradigms, mean of 
traditional paradigms for candidate profiles. 

2. Correlation between profile types and criteria 
discriminators: actual for candidate profiles, mean of 
candidate profiles for traditional paradigms. 

Reasonably strong correlations were found within stock 
Issues, Tabula Rasa and Analytic Centered profile types. 
Otherwise, no associations of any importance were seen. 

The Stock Issues profile type was correlated fairly strongly 
(.52) with Affirmative Burden, in part confirming strength of 
cl'ister association findings from the previous analysis. 
Affirmative Burden also was fairly strongly associated (.35) with 
Tabula Rasa critics. The Analytic Centered profile exhibited 
moderate correlation with Affirmative Burden and Applicability of 
Evidence (.31 and .24, respectively). 

All traditional paradigms showed stronger correlations to 
the key discriminators than the mean correlation for each 
discriminator shown by the proposed profile types. 

Some new profile correlations were stronger than the mean 
correlation for traditional paradigms on key discriminators, 
especially for the Analytic centered profile type. But generally 
speak infjf traditional paradigms were more strongly associated 
with key discriminators than were new profile types. 

Finally, research question #4 asked how the profiles ranked 
to -^ne another based upon their predictive ability. To answer 
this question the absolute means for all key discriminators was 
calculated for each profile type. Each type was then ranked in 
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order of the highest mean correlation. 



TABLE 8 



Ranking of Mean Absolute correlations of Traditional 
vs. Candidate Profile Types With Criteria Discriminators 



Profile Type 



Traditional 



Candidate 



Mean Abs 
Correlation 



Rank 



Stock Issues 
Analytic Centered 
Tabula Rasa 
Argument Critic 
Argument skills - 

Hypothesis Test 
value comparison 

Argument Skills 
Audience Centered 



* 



.057 



.240 
.203 
.177 
.140 
.112 



.057 



6 



6 



1 
2 
3 
4 
5 



None of the seven candidate profiles correlated strongly 
with the key criteria discriminators. However ^ ranking the 
profiles by mean correlation did emphasize earlier findings that 
traditional paradigms are more strongly correlated to the key 
discriminators than are any of the suggested new profiles. 
Additionally, only Stock Issues showed a moderately strong (.241 
correlation to key discriminators. 



Analyses in this report suggest direction for further 
investigation. In all instances these suggestions are nominal 
given the subcritical sample size upon which these analyses were 
based, Nevertheles.s, the data show consistent patterns which at 
least warrant the pursuit of ta.xonmic elements. The following 
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(Table 9) summarises the patterns of associations revealed. 

TABLE 9 
Summary of Associations 



Pai:a'3igni/5x,Qille, 



Characteristics 



Tabula Rasa 
Value Comparison- 
Argument Skills 
Stock Issues 

Argument Skllls- 

Hypothosis Testing 
Argument Critic 
Audience Centered 
Analytic Centered 



Affirmative Burden, Aprlicabillty of Ev 
Affirmative Burden, Applicability of Ev 

Affirmative Burden, Applicability of Ev, 
Quality of Analysis 



First, analysis revealed thee traditional paradigms are 
associated more strongly to key discriminators than are merged or 
new profile types. Given the limited number of discriminators 
(Quality of Analysis, Affirmative Burden, and Applicability of 
Evidence) utilized, it would be premature to dismiss the 
possibility of alternate taxonomic element's. Subsequent research 
needs to extract a richer set of discriminants, which could then 
be applied to both traditional paradigms as well as to candidate 
profiles . 

Second, the criteria discriminators, despite their 
limitations, are associated with relatively clearly defined 
profile types. However, the profile types with which these 
discriminants are associated are not conceptually coherent. 
The Stock Issues paradigm, for instance, with its location of 
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presumption with existing institutions, has a coherent 
relationship with the discriminant "Affirmative Burden of Proof. 
Tabula Rasa, on the other hand, which does not presuppose the 
location of presumption, is not coherent with Affirmative Burden 
of Proof as one of its discriminants. 

The question of coherence between paradigm profile types 
with criteria discriminators requires that future research 
consider two procedures; (1) define paradigm characteristics so 
far as they have been defined by their literature, and (2) 
incorporate paradigm characteristics into the criteria 
discriminators for subsequant analysis. 

Third, the present analysis suggests that at least the 
following profile types should be considered as targets of future 
research in CEDA paradigm use; Value~Compc?r ison Argument 
Skills, Argument Skills - Hypothesis Testing, Argument Critic, 
Stock Issues, and Analytic Centered. Three of these profiles 
(Stock Issues, Hypothesis Testing, and Value Comparison - 
Argument Skills) received support across more than one 
measurement while Argument Cen<*ered, Argument Critic, and 
Argument Skills - Hypothesis Testing were suggested by one of the 
manipulations . 

Finally, the descriptive boundaries between paradigms are 
porous and unreliable. The low correlation distinctiveness 
between profile types (even when using traditional paradigms) 
suggests that paradigm adherence by critics is not a highly 
valued behavior. Lack of critic consistency was identified 
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previously in Dudcsak and Day (1989) as due to the employment oc 
multiple paradigms by critics. Nearly all critics (94%) were 
willing to use an alternate paradigm to the p*-»ference if asked 
to do so by debaters. If critics are inconsistent in applying 
their professed criteria in actual ballot behavior^ paradigms 
diminished in their value of predicting or understanding decision 
rules employed by the judge critic. 

Further research clearly requires a larger and more 
representative sample. The analytic procedures employed in the 
current analysis are applicable to an expanded database. 
Elaboration of criteria discriminators should reveal if the 
t:raditional or profile candidates do support taxonomic elements 
which would inform debaters of real differences existing among 
their judge-critics. 
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ENDNOTES 



1. There was an observed correlation (r ^- .699) between 
critics* survey response "evidence out of context'* and t: e 
presence of this element in their ballots^ Similarly, there 
was an observed correlation (r .698) between the survey 
response 'Equality of analysis'' and ballot comments 
addressing "evidence out of context." 

2. Tabula rasa^t Value Comparison, Argument Skills, Hypotr:*^- 
Testing, Judicial Model, and Argument Critic all simile } * 
correlated (r .698 to .685) with the presence of cotri. >/ ^ 
addressing "evidence out of context" on critics' balic. 
Value Comparison, Argument Skills, Judicial Model, c-nd 
Argument Critic correlated iMikh comments addressing 
"counterintuitive arguments" in their ballots (r - .:'7/i 
to .644). Critics identifying with the Judicial fl*-u i ; 
claiming to be Argument Critics were likely to citi "qj .: .*. Ly 
of analysis*' <r - .589 to •fJSS) in their decision^i. 

3. Page numbers for "A Profile of CEDA Debate Critics" a^ ♦ I. 
paqo f:ount. The format f^ar papf:?rs pr^^sented at t.^i^l b,'! •/ »• 
Summer Argumentation Conference requires that manusc rir?; - i - 
submitted without pagmatiot^ ♦ Th«-? lO-^ou-^r r xp t • r«:m ti » ' 
Conference iK currently i,indt??r review for v ts publication in 
the proceedings. 

4. The highest consistency rating for a single cr iti-:: w^a:s 
wHis 66.9/1, wtfhile the lowest consLStencyratyinq wa*> 31-. 

5- Data tested by the two hypotheses skewed in the eHp'-^c*" *! 
direction, but results did not approach statistical sig- 
nificance (p < .05). 
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the br3ilIots and philosophy statements* HQWt5v«^r, this 
detensible for a piiat (thotigh not for an expanded sampl:?). 
(See K^rippendor f f , !v • ^ Vi:^? • ,l<T.^-rpd«.it^?: V<^«'l. 

t-t ?^«^t hqdpj o^jy 7^ » ) 

?• The survey ini> t rumen t and c;ontent analysis worksh.?etr> 

wer^ revi'BHjri for a natxcnai fjampie un^ierway daring Fait. .l7-iV, 

9- The nine discriminants were sovf^n BUD<otantivB i Af r irfr^nA^'iJ^ 
f i.a t , Ccun ter in tui t ive ar^jumen t ^ re:)pi ca I x tVi »-Jua i i ty « : ^ 
analysis. Evidence out of contsMt. Aff Burden of proo ' < k 
App I X rabi 1 1 ty of evid*^nce) and two prosen tatxonai (£y^ con- 
tact and Obno:tious behavior) ©lf?ments seiectad from ti^^ 3? 
Lxkert-- 1 xke x terns. 

9. Krippendorf f , for instance, cite^ a correal ration of .iiO - 

n©c©«3sary for prcvtsxonal acceptance, 

10. Pairs which are considered atypical ly ^i nxlar in tenffC> :jy 
key discriminant*^ have a difference of no n^ore than 0,1 
corr^el a tion on five or more of the si-c discriminators.^ 

11. Note tt>at Judicial {^odel i^ a component of each weak pair, 

12i^ Note that Argument Skills is a component of each etror .j 
pair • 

13. When two paradigm?^ are combined for correlation compar <'>onLi, 
an averaging effect of the two paradig^n<3 may operate t • 
reduce the correlation o1 the combined paradigriui coMp.''«^d 
with the single paradigm effect* 

14* A paradigm pair is consid^f red dissimilar when th3re wa^ 

difference of O'D^lej^:© than 0.3 correlaht jn on jjij^j^ 
d i scr xm i n a_t g rs « 

i!rw Most paradigms appear to iacK clear boundary definite r ir. 
terms of key dicvcr Lm!.na tor-^. tven those pa irs with c; 
tuiBmatches are questionable xn ti^exr dissi mt 1 an ty ^ i-f*.. Is 
a mi5m,>t<:h on only two i m in-\tr.r^ aoeciuar.-? 

boiindary ci^f ini tion"^ 

16. Aucfi «^fu:e*^cen tered cot-nhmeci Hrgi.nr??nt iSkiili^i Arg>Ufu?nt: C.- itic^ 
and Pub I ic Aud tence • 

ir. Anal vtic-'cen tered combined v^^iu^? CompMri^on. FA)3 i.-:^' 

Imp! :c.xtion*s, StocJ* ls'^u*^v>, Hypotn^^st; r^^^tirg tvnd J'»J:riril 
Model. 
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18. T.^bula Rc>sa W5is identxtaed by 63/1 critic^i a^r ^ ;i ^, v.: : 
they employed-r To tt?^t th»? candxdat*-? ^i^abilicy a** i acv, ^ \ 
Pasa, it was compared against critics who did not select r^: 

a paraaxgift cr'»o c<-** 

19. i hef>e r^^sul t'S suggest a possible CDv^r^i =\ncf? bc^twe ^.^ 
Artirmativ^ Burden and Appl i.v:aoi. 1 i vy or 5£vldt3r.c:*? , / ? 
Dt in<:er©st xn tutors? research* 
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